2026-09-30 16:43:33,619 [ 300742 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-09-30 16:43:33,619 [ 300742 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-09-30 16:43:33,619 [ 300742 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-09-30 16:43:33,619 [ 300742 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_cru6dj --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' test_part_uuid/test.py::test_part_uuid test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_replica/test.py::test_choose_source_replica test_recovery_replica/test.py::test_recovery test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update test_storage_s3_queue/test.py::test_commit_on_limit 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered]' -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_storage_hudi/test.py::test_multiple_hudi_files test_reloading_storage_configuration/test.py::test_add_disk test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_storage_redis/test.py::test_create_table test_rocksdb_options/test.py::test_invalid_block_based_table_options test_recovery_replica/test.py::test_choose_source_replica test_session_log/test.py::test_grpc_session test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy [gw7] [ 1%] PASSED test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session [gw7] [ 2%] PASSED test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions [gw4] [ 3%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] [gw2] [ 4%] PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options [gw7] [ 5%] PASSED test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session [gw0] [ 6%] PASSED test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with [gw7] [ 7%] PASSED test_session_log/test.py::test_postgres_session [gw1] [ 8%] PASSED test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy [gw4] [ 9%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] [gw6] [ 10%] PASSED test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_row_policy/test.py::test_change_of_users_xml_changes_row_policies [gw6] [ 11%] PASSED test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int [gw4] [ 12%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] [gw6] [ 13%] PASSED test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_s3_queue/test.py::test_commit_on_limit [gw6] [ 14%] PASSED test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select [gw6] [ 15%] PASSED test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate [gw4] [ 16%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] [gw1] [ 17%] PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config [gw6] [ 18%] PASSED test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update [gw2] [ 19%] PASSED test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options [gw6] [ 20%] PASSED test_storage_redis/test.py::test_update [gw4] [ 21%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] [gw0] [ 22%] PASSED test_row_policy/test.py::test_change_of_users_xml_changes_row_policies [gw4] [ 23%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] [gw1] [ 24%] PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_row_policy/test.py::test_dcl_introspection [gw1] [ 25%] PASSED test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy [gw2] [ 26%] PASSED test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options [gw0] [ 27%] PASSED test_row_policy/test.py::test_dcl_introspection test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_row_policy/test.py::test_dcl_management [gw1] [ 28%] PASSED test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works [gw0] [ 29%] PASSED test_row_policy/test.py::test_dcl_management [gw2] [ 30%] PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml [gw0] [ 31%] PASSED test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml [gw1] [ 32%] PASSED test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_row_policy/test.py::test_grant_create_row_policy [gw0] [ 33%] PASSED test_row_policy/test.py::test_grant_create_row_policy [gw1] [ 34%] PASSED test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_row_policy/test.py::test_introspection [gw0] [ 35%] PASSED test_row_policy/test.py::test_introspection [gw2] [ 36%] PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_row_policy/test.py::test_join [gw0] [ 37%] PASSED test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines [gw1] [ 38%] PASSED test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy [gw9] [ 39%] PASSED test_recovery_replica/test.py::test_choose_source_replica test_recovery_replica/test.py::test_recovery [gw0] [ 40%] PASSED test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned [gw1] [ 41%] PASSED test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy [gw0] [ 42%] PASSED test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned [gw2] [ 43%] PASSED test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options [gw9] [ 44%] PASSED test_recovery_replica/test.py::test_recovery test_recovery_replica/test.py::test_update_metadata [gw2] [ 45%] PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options [gw2] [ 46%] PASSED test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options [gw2] [ 47%] PASSED test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_policy_on_distributed_table_via_role [gw2] [ 48%] PASSED test_rocksdb_options/test.py::test_valid_options [gw0] [ 49%] PASSED test_row_policy/test.py::test_policy_on_distributed_table_via_role test_reload_zookeeper/test.py::test_reload_zookeeper [gw1] [ 50%] PASSED test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk test_row_policy/test.py::test_reload_users_xml_by_timer [gw1] [ 51%] PASSED test_reloading_storage_configuration/test.py::test_update_disk test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop [gw0] [ 52%] PASSED test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery [gw0] [ 53%] PASSED test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke [gw4] [ 54%] PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings [gw9] [ 55%] PASSED test_recovery_replica/test.py::test_update_metadata [gw0] [ 56%] PASSED test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_read_temporary_tables_on_failure/test.py::test_different_versions [gw0] [ 57%] PASSED test_row_policy/test.py::test_some_users_without_policies [gw4] [ 58%] PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings test_row_policy/test.py::test_tags_with_db_and_table_names [gw0] [ 59%] PASSED test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter [gw0] [ 60%] PASSED test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter [gw0] [ 61%] PASSED test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data [gw0] [ 62%] PASSED test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data [gw0] [ 63%] PASSED test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly [gw0] [ 64%] PASSED test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere [gw0] [ 65%] PASSED test_row_policy/test.py::test_with_prewhere [gw1] [ 66%] PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop [gw2] [ 67%] PASSED test_reload_zookeeper/test.py::test_reload_zookeeper test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl [gw4] [ 68%] PASSED test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster [gw9] [ 69%] PASSED test_read_temporary_tables_on_failure/test.py::test_different_versions test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_replace_partition/test.py::test_normal_work [gw9] [ 70%] PASSED test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side [gw9] [ 71%] PASSED test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side [gw8] [ 72%] ERROR test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file [gw8] [ 73%] ERROR test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types [gw8] [ 74%] ERROR test_storage_hudi/test.py::test_types [gw2] [ 75%] PASSED test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings [gw2] [ 76%] PASSED test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings [gw4] [ 77%] ERROR test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage [gw3] [ 78%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] [gw3] [ 79%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format [gw5] [ 80%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy [gw3] [ 81%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] [gw5] [ 82%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list [gw3] [ 83%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] [gw5] [ 84%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy [gw3] [ 85%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] [gw5] [ 86%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy [gw3] [ 87%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] [gw5] [ 88%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy [gw3] [ 89%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] [gw5] [ 90%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy [gw3] [ 91%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format [gw3] [ 92%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format [gw6] [ 93%] ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns [gw6] [ 94%] ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_part_uuid/test.py::test_part_uuid [gw6] [ 95%] PASSED test_part_uuid/test.py::test_part_uuid [gw1] [ 96%] ERROR test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replication_without_zookeeper/test.py::test_startup_without_zookeeper [gw1] [ 97%] PASSED test_replication_without_zookeeper/test.py::test_startup_without_zookeeper [gw7] [ 98%] ERROR test_storage_s3_queue/test.py::test_commit_on_limit test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered] [gw7] [ 99%] ERROR test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered] test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered] [gw7] [100%] ERROR test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered] ==================================== ERRORS ==================================== __________________ ERROR at setup of test_multiple_hudi_files __________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): cluster = ClickHouseCluster(__file__, with_spark=True) try: cluster.add_instance( "node1", main_configs=["configs/config.d/named_collections.xml"], user_configs=["configs/users.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_hudi/test.py:59: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- 26/09/30 16:43:39 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:43:37 [ 604 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 604 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 604 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:43:37 [ 604 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:43:37 [ 604 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 604 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 604 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV HOSTNAME b5ab15b2a465 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' test_part_uuid/test.py::test_part_uuid test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_replica/test.py::test_choose_source_replica test_recovery_replica/test.py::test_recovery test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update test_storage_s3_queue/test.py::test_commit_on_limit 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered]' -vvv (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV WORKER_FREE_PORTS 30400 30401 30402 30403 30404 30405 30406 30407 30408 30409 30410 30411 30412 30413 30414 30415 30416 30417 30418 30419 30420 30421 30422 30423 30424 30425 30426 30427 30428 30429 30430 30431 30432 30433 30434 30435 30436 30437 30438 30439 30440 30441 30442 30443 30444 30445 30446 30447 30448 30449 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID fab65bf9afe2472dba8da715b12a1bd6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PYTEST_XDIST_WORKER gw8 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : ENV PYTEST_CURRENT_TEST test_storage_hudi/test.py::test_multiple_hudi_files (setup) (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 604 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:43:39 [ 604 ] DEBUG : GatewayClient.address is deprecated and will be removed in version 1.0. Use GatewayParameters instead. (java_gateway.py:163, deprecated) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: A 02cb2ba85d25d330a84e5a263113e2f31835f8556b4b45920e553960b55abea8 (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.SparkConf e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.api.java.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.api.python.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.ml.python.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.mllib.api.python.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.resource.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.sql.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.sql.api.python.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj org.apache.spark.sql.hive.* e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: j i rj scala.Tuple2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: r u SparkConf rj e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.SparkConf (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: i org.apache.spark.SparkConf bTrue e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro0 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 set sspark.app.name sspark_test e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro1 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 set sspark.master slocal e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro2 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 contains sspark.serializer.objectStreamReset e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 set sspark.serializer.objectStreamReset s100 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro3 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 contains sspark.rdd.compress e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 set sspark.rdd.compress sTrue e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro4 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 get sspark.master e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 get sspark.app.name e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 contains sspark.home e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o0 getAll e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yto5 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i0 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro6 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o6 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.master (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o6 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro7 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o7 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.app.submitTime (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o7 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ys1790786619551 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o8 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.app.name (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o8 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i3 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro9 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o9 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.rdd.compress (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o9 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysTrue (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i4 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro10 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o10 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.serializer.objectStreamReset (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o10 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ys100 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro11 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o11 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.submit.pyFiles (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o11 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i6 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro12 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o12 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.submit.deployMode (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o12 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysclient (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a g o5 i7 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yro13 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o13 _1 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ysspark.ui.showConsoleProgress (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: c o13 _2 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ystrue (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: r u JavaSparkContext rj e (clientserver.py:501, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.api.java.JavaSparkContext (clientserver.py:512, send_command) 2026-09-30 16:43:39 [ 604 ] DEBUG : Command to send: i org.apache.spark.api.java.JavaSparkContext ro0 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: A 02cb2ba85d25d330a84e5a263113e2f31835f8556b4b45920e553960b55abea8 (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: m d o1 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: m d o2 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: m d o3 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: m d o4 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: m d o5 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro14 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro15 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o15 conf e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro16 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u PythonAccumulatorV2 rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonAccumulatorV2 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonAccumulatorV2 s127.0.0.1 i55357 s02cb2ba85d25d330a84e5a263113e2f31835f8556b4b45920e553960b55abea8 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro17 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro18 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o18 register ro17 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils isEncryptionEnabled e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils isEncryptionEnabled ro14 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout ro14 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yL15 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getSparkBufferSize e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getSparkBufferSize ro14 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yi65536 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark.SparkFiles rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.SparkFiles (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ys/tmp/spark-99722307-cfdb-4548-999c-8f88ad45b4ab/userFiles-208214f4-08c1-4b69-9c6f-9f7e551160ce (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o16 get sspark.submit.pyFiles s e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.util.Utils getLocalDir e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro19 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o19 conf e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro20 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils getLocalDir ro20 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ys/tmp/spark-99722307-cfdb-4548-999c-8f88ad45b4ab (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.util.Utils createTempDir e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils createTempDir s/tmp/spark-99722307-cfdb-4548-999c-8f88ad45b4ab spyspark e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro21 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o21 getAbsolutePath e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ys/tmp/spark-99722307-cfdb-4548-999c-8f88ad45b4ab/pyspark-47407772-b349-447d-a7e0-91734aca9dd5 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o16 get sspark.python.profile sfalse e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro22 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o22 isDefined e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro23 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yao24 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o24 put sspark.app.name sspark_test e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o24 put sspark.master slocal e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: i org.apache.spark.sql.SparkSession ro23 ro24 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yro25 (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setDefaultSession e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setDefaultSession ro25 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro25 e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Command to send: c o14 stop e (clientserver.py:501, send_command) 2026-09-30 16:43:40 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:41 [ 604 ] DEBUG : Cluster name: project_name:rootteststoragehudi_gw8. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:41 [ 604 ] INFO : Starting cluster... (test.py:58, started_cluster) 2026-09-30 16:43:41 [ 604 ] INFO : Running tests in /ClickHouse/tests/integration/test_storage_hudi/test.py (cluster.py:2790, start) 2026-09-30 16:43:41 [ 604 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:43:41 [ 604 ] DEBUG : Docker networks for project rootteststoragehudi_gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:41 [ 604 ] DEBUG : Docker containers for project rootteststoragehudi_gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:41 [ 604 ] DEBUG : Docker volumes for project rootteststoragehudi_gw8 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:41 [ 604 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:43:41 [ 604 ] DEBUG : Docker networks for project rootteststoragehudi_gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:41 [ 604 ] DEBUG : Docker containers for project rootteststoragehudi_gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:41 [ 604 ] DEBUG : Docker volumes for project rootteststoragehudi_gw8 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command:docker container list --all --filter name='^/rootteststoragehudi_gw8_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 604 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:43:41 [ 604 ] DEBUG : No running containers for project: rootteststoragehudi_gw8 (cluster.py:904, cleanup) 2026-09-30 16:43:41 [ 604 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:43:41 [ 604 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 604 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:43:41 [ 604 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 16:43:41 [ 604 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_hudi/configs/config.d/named_collections.xml'] to /ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/database (cluster.py:4653, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:41 [ 604 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env (cluster.py:86, _create_env_file) 2026-09-30 16:43:41 [ 604 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:43:41 [ 604 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:43:41 [ 604 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:43:41 [ 604 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:43:41 [ 604 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o24 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o6 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o7 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o8 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o9 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o10 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o11 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o12 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o13 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o15 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o18 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o19 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o20 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o21 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o22 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Command to send: m d o23 e (clientserver.py:501, send_command) 2026-09-30 16:43:41 [ 604 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:40 [ 604 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:44:40 [ 604 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:44:41 [ 604 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:44 [ 604 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:45:44 [ 604 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:45:46 [ 604 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:37 [ 604 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:46:37 [ 604 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:46:40 [ 604 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:40 [ 604 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:47:40 [ 604 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:47:44 [ 604 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:48:42 [ 604 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:48:42 [ 604 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:48:42 [ 604 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:48:42 [ 604 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Docker networks for project rootteststoragehudi_gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:48:42 [ 604 ] DEBUG : Docker containers for project rootteststoragehudi_gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:48:42 [ 604 ] DEBUG : Docker volumes for project rootteststoragehudi_gw8 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:48:42 [ 604 ] DEBUG : Command:docker container list --all --filter name='^/rootteststoragehudi_gw8_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : No running containers for project: rootteststoragehudi_gw8 (cluster.py:904, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:48:42 [ 604 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:48:42 [ 604 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Docker networks for project rootteststoragehudi_gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:48:42 [ 604 ] DEBUG : Docker containers for project rootteststoragehudi_gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:48:42 [ 604 ] DEBUG : Docker volumes for project rootteststoragehudi_gw8 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:48:42 [ 604 ] DEBUG : Command:docker container list --all --filter name='^/rootteststoragehudi_gw8_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : No running containers for project: rootteststoragehudi_gw8 (cluster.py:904, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:48:42 [ 604 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:48:42 [ 604 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ___________________ ERROR at setup of test_single_hudi_file ____________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): cluster = ClickHouseCluster(__file__, with_spark=True) try: cluster.add_instance( "node1", main_configs=["configs/config.d/named_collections.xml"], user_configs=["configs/users.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_hudi/test.py:59: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________________ ERROR at setup of test_types _________________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): cluster = ClickHouseCluster(__file__, with_spark=True) try: cluster.add_instance( "node1", main_configs=["configs/config.d/named_collections.xml"], user_configs=["configs/users.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_hudi/test.py:59: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_vertical_merge_memory_usage ______________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_single_node_cluster(): try: > single_node_cluster.start() test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py:20: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling small_node ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling small_node ... pulling from altinityinfra/integr... E Pulling small_node ... digest: sha256:2ea9da862c215fd684... E Pulling small_node ... status: image is up to date for a... E Pulling small_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling small_node ... pulling from altinityinfra/integr... Pulling small_node ... digest: sha256:2ea9da862c215fd684... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:46:55 [ 562 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py (cluster.py:2790, start) 2026-09-30 16:46:55 [ 562 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:46:55 [ 562 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:55 [ 562 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:55 [ 562 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:55 [ 562 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:55 [ 562 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:55 [ 562 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:55 [ 562 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:55 [ 562 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyttlverticalmergememoryusage_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:55 [ 562 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:55 [ 562 ] DEBUG : No running containers for project: roottests3zerocopyttlverticalmergememoryusage_gw4 (cluster.py:904, cleanup) 2026-09-30 16:46:55 [ 562 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:55 [ 562 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:55 [ 562 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:55 [ 562 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:55 [ 562 ] DEBUG : Setup directory for instance: small_node (cluster.py:2810, start) 2026-09-30 16:46:55 [ 562 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_ttl/configs/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/database (cluster.py:4653, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/logs (cluster.py:4664, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:46:55 [ 562 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env (cluster.py:86, _create_env_file) 2026-09-30 16:46:55 [ 562 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:55 [ 562 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:55 [ 562 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:55 [ 562 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:55 [ 562 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:46:55 [ 562 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 562 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:47:50 [ 562 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling small_node ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling resolver ... done Pulling small_node ... digest: sha256:2ea9da862c215fd684... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:47:53 [ 562 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 562 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:52 [ 562 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling small_node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling small_node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling small_node ... digest: sha256:2ea9da862c215fd684... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:55 [ 562 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:55 [ 562 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:49:55 [ 562 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling small_node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling small_node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling small_node ... digest: sha256:2ea9da862c215fd684... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:49:57 [ 562 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 562 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:47 [ 562 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling small_node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling small_node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling small_node ... digest: sha256:2ea9da862c215fd684... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:52 [ 562 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:51:54 [ 562 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage_gw4', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0_gw4/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling small_node ... pulling from altinityinfra/integr... Pulling small_node ... digest: sha256:2ea9da862c215fd684... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:51:54 [ 562 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:51:54 [ 562 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:51:54 [ 562 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:51:54 [ 562 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:51:54 [ 562 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:51:54 [ 562 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyttlverticalmergememoryusage_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : No running containers for project: roottests3zerocopyttlverticalmergememoryusage_gw4 (cluster.py:904, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:51:54 [ 562 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:51:54 [ 562 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:51:54 [ 562 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:51:54 [ 562 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:51:54 [ 562 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyttlverticalmergememoryusage_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : No running containers for project: roottests3zerocopyttlverticalmergememoryusage_gw4 (cluster.py:904, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:51:54 [ 562 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:51:54 [ 562 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _____________________ ERROR at setup of test_log_table[s3] _____________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo3 ... Pulling switching_node ... Pulling new_node ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling switching_node ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling switching_node ... digest: sha256:2ea9da862c215fd684... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling new_node ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling new_node ... digest: sha256:2ea9da862c215fd684... Pulling new_node ... status: image is up to date for a... Pulling zoo2 ... done Pulling node ... done Pulling new_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:43:37 [ 559 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:43:37 [ 559 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:43:37 [ 559 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV HOSTNAME b5ab15b2a465 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' test_part_uuid/test.py::test_part_uuid test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_replica/test.py::test_choose_source_replica test_recovery_replica/test.py::test_recovery test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update test_storage_s3_queue/test.py::test_commit_on_limit 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered]' -vvv (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV WORKER_FREE_PORTS 30150 30151 30152 30153 30154 30155 30156 30157 30158 30159 30160 30161 30162 30163 30164 30165 30166 30167 30168 30169 30170 30171 30172 30173 30174 30175 30176 30177 30178 30179 30180 30181 30182 30183 30184 30185 30186 30187 30188 30189 30190 30191 30192 30193 30194 30195 30196 30197 30198 30199 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID fab65bf9afe2472dba8da715b12a1bd6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PYTEST_XDIST_WORKER gw3 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : ENV PYTEST_CURRENT_TEST test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] (setup) (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:43:37 [ 559 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 16:43:37 [ 559 ] DEBUG : Cluster name:backward_compatibility project_name:roottestremoteblobsnamingbackwardcompatibility_gw3. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 559 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 559 ] DEBUG : Cluster name:backward_compatibility project_name:roottestremoteblobsnamingbackwardcompatibility_gw3. Added instance name:new_node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 559 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 559 ] DEBUG : Cluster name:backward_compatibility project_name:roottestremoteblobsnamingbackwardcompatibility_gw3. Added instance name:switching_node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 559 ] INFO : Starting cluster... (test_backward_compatibility.py:55, cluster) 2026-09-30 16:43:37 [ 559 ] INFO : Running tests in /ClickHouse/tests/integration/test_remote_blobs_naming/test_backward_compatibility.py (cluster.py:2790, start) 2026-09-30 16:43:37 [ 559 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:43:37 [ 559 ] DEBUG : Docker networks for project roottestremoteblobsnamingbackwardcompatibility_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:37 [ 559 ] DEBUG : Docker containers for project roottestremoteblobsnamingbackwardcompatibility_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:37 [ 559 ] DEBUG : Docker volumes for project roottestremoteblobsnamingbackwardcompatibility_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:37 [ 559 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:43:37 [ 559 ] DEBUG : Docker networks for project roottestremoteblobsnamingbackwardcompatibility_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:37 [ 559 ] DEBUG : Docker containers for project roottestremoteblobsnamingbackwardcompatibility_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:37 [ 559 ] DEBUG : Docker volumes for project roottestremoteblobsnamingbackwardcompatibility_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:37 [ 559 ] DEBUG : Command:docker container list --all --filter name='^/roottestremoteblobsnamingbackwardcompatibility_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:43:37 [ 559 ] DEBUG : No running containers for project: roottestremoteblobsnamingbackwardcompatibility_gw3 (cluster.py:904, cleanup) 2026-09-30 16:43:37 [ 559 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:43:37 [ 559 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:43:37 [ 559 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:43:37 [ 559 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_remote_blobs_naming/configs/old_node.xml', '/ClickHouse/tests/integration/test_remote_blobs_naming/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup directory for instance: new_node (cluster.py:2810, start) 2026-09-30 16:43:37 [ 559 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_remote_blobs_naming/configs/new_node.xml', '/ClickHouse/tests/integration/test_remote_blobs_naming/configs/storage_conf_new.xml'] to /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup directory for instance: switching_node (cluster.py:2810, start) 2026-09-30 16:43:37 [ 559 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_remote_blobs_naming/configs/switching_node.xml', '/ClickHouse/tests/integration/test_remote_blobs_naming/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 559 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env (cluster.py:86, _create_env_file) 2026-09-30 16:43:37 [ 559 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:43:37 [ 559 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:43:37 [ 559 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:43:37 [ 559 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:43:37 [ 559 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:43:37 [ 559 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 559 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:45:23 [ 559 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling new_node ... Pulling node ... Pulling switching_node ... Pulling switching_node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling switching_node ... digest: sha256:2ea9da862c215fd684... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling new_node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling new_node ... digest: sha256:2ea9da862c215fd684... Pulling new_node ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling new_node ... done Pulling resolver ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:45:26 [ 559 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 559 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:47:08 [ 559 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo2 ... Pulling proxy2 ... Pulling zoo1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling switching_node ... Pulling node ... Pulling new_node ... Pulling node ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... done Pulling new_node ... pulling from altinityinfra/integr... Pulling new_node ... digest: sha256:2ea9da862c215fd684... Pulling new_node ... status: image is up to date for a... Pulling new_node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling switching_node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling switching_node ... digest: sha256:2ea9da862c215fd684... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:47:11 [ 559 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 559 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:52 [ 559 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling node ... Pulling new_node ... Pulling switching_node ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling new_node ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... done Pulling new_node ... digest: sha256:2ea9da862c215fd684... Pulling new_node ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling new_node ... done Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling switching_node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling zoo1 ... done Pulling node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling switching_node ... digest: sha256:2ea9da862c215fd684... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:55 [ 559 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 559 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:37 [ 559 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling new_node ... Pulling switching_node ... Pulling node ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling switching_node ... pulling from altinityinfra/integr... Pulling new_node ... pulling from altinityinfra/integr... Pulling switching_node ... digest: sha256:2ea9da862c215fd684... Pulling switching_node ... status: image is up to date for a... Pulling new_node ... digest: sha256:2ea9da862c215fd684... Pulling new_node ... status: image is up to date for a... Pulling switching_node ... done Pulling new_node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:40 [ 559 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:52:24 [ 559 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:52:24 [ 559 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo3 ... Pulling switching_node ... Pulling new_node ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling switching_node ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling switching_node ... digest: sha256:2ea9da862c215fd684... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling new_node ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling new_node ... digest: sha256:2ea9da862c215fd684... Pulling new_node ... status: image is up to date for a... Pulling zoo2 ... done Pulling node ... done Pulling new_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:52:24 [ 559 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:52:24 [ 559 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:52:24 [ 559 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:52:24 [ 559 ] DEBUG : Docker networks for project roottestremoteblobsnamingbackwardcompatibility_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:52:24 [ 559 ] DEBUG : Docker containers for project roottestremoteblobsnamingbackwardcompatibility_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:52:24 [ 559 ] DEBUG : Docker volumes for project roottestremoteblobsnamingbackwardcompatibility_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:52:24 [ 559 ] DEBUG : Command:docker container list --all --filter name='^/roottestremoteblobsnamingbackwardcompatibility_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:52:25 [ 559 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:52:25 [ 559 ] DEBUG : No running containers for project: roottestremoteblobsnamingbackwardcompatibility_gw3 (cluster.py:904, cleanup) 2026-09-30 16:52:25 [ 559 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:52:25 [ 559 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:52:25 [ 559 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:52:25 [ 559 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) __________________ ERROR at setup of test_log_table[s3_plain] __________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_s3_with_https_env_no_proxy _______________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "remote_proxy_node_no_proxy", main_configs=[ "configs/config.d/proxy_remote_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node_no_proxy", main_configs=[ "configs/config.d/proxy_list_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) cluster.add_instance( "env_node_no_proxy", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", "no_proxy": "not_important_host,, minio1 ,", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:79: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling proxy_list_node ... E Pulling env_node_no_proxy ... E Pulling remote_proxy_node ... E Pulling env_node ... E Pulling remote_proxy_node_no_proxy ... E Pulling proxy_list_node_no_proxy ... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node_no_proxy ... done E Pulling env_node ... digest: sha256:2ea9da862c215fd684... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... done E Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling env_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling env_node_no_proxy ... status: image is up to date for a... E Pulling env_node_no_proxy ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling proxy_list_node ... Pulling env_node_no_proxy ... Pulling remote_proxy_node ... Pulling env_node ... Pulling remote_proxy_node_no_proxy ... Pulling proxy_list_node_no_proxy ... Pulling env_node ... pulling from altinityinfra/integr... Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node_no_proxy ... done Pulling env_node ... digest: sha256:2ea9da862c215fd684... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node_no_proxy ... done Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling env_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling env_node_no_proxy ... status: image is up to date for a... Pulling env_node_no_proxy ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:43:37 [ 565 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:43:37 [ 565 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:43:37 [ 565 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV HOSTNAME b5ab15b2a465 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' test_part_uuid/test.py::test_part_uuid test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_replica/test.py::test_choose_source_replica test_recovery_replica/test.py::test_recovery test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update test_storage_s3_queue/test.py::test_commit_on_limit 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered]' -vvv (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV WORKER_FREE_PORTS 30250 30251 30252 30253 30254 30255 30256 30257 30258 30259 30260 30261 30262 30263 30264 30265 30266 30267 30268 30269 30270 30271 30272 30273 30274 30275 30276 30277 30278 30279 30280 30281 30282 30283 30284 30285 30286 30287 30288 30289 30290 30291 30292 30293 30294 30295 30296 30297 30298 30299 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID fab65bf9afe2472dba8da715b12a1bd6 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PYTEST_XDIST_WORKER gw5 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : ENV PYTEST_CURRENT_TEST test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy (setup) (cluster.py:446, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:43:37 [ 565 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy_gw5. Added instance name:remote_proxy_node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy_gw5. Added instance name:remote_proxy_node_no_proxy tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy_gw5. Added instance name:proxy_list_node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy_gw5. Added instance name:proxy_list_node_no_proxy tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy_gw5. Added instance name:env_node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy_gw5. Added instance name:env_node_no_proxy tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:43:37 [ 565 ] INFO : Starting cluster... (test.py:78, cluster) 2026-09-30 16:43:37 [ 565 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/test.py (cluster.py:2790, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy_gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:37 [ 565 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy_gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:37 [ 565 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy_gw5 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:37 [ 565 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:43:37 [ 565 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy_gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:37 [ 565 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy_gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:37 [ 565 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy_gw5 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:37 [ 565 ] DEBUG : Command:docker container list --all --filter name='^/roottests3tablefunctionwithhttpsproxy_gw5_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:43:37 [ 565 ] DEBUG : No running containers for project: roottests3tablefunctionwithhttpsproxy_gw5 (cluster.py:904, cleanup) 2026-09-30 16:43:37 [ 565 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:43:37 [ 565 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:43:37 [ 565 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup directory for instance: remote_proxy_node (cluster.py:2810, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/proxy_remote.xml', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup directory for instance: remote_proxy_node_no_proxy (cluster.py:2810, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/proxy_remote_no_proxy.xml', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup directory for instance: proxy_list_node (cluster.py:2810, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/proxy_list.xml', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup directory for instance: proxy_list_node_no_proxy (cluster.py:2810, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/proxy_list_no_proxy.xml', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup directory for instance: env_node (cluster.py:2810, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/certs/public.crt', 'https_proxy': 'https://proxy1'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/.env (cluster.py:86, _create_env_file) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup directory for instance: env_node_no_proxy (cluster.py:2810, start) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/database (cluster.py:4653, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/logs (cluster.py:4664, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:43:37 [ 565 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/certs/public.crt', 'https_proxy': 'https://proxy1', 'no_proxy': 'not_important_host,, minio1 ,'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/.env (cluster.py:86, _create_env_file) 2026-09-30 16:43:37 [ 565 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env (cluster.py:86, _create_env_file) 2026-09-30 16:43:37 [ 565 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:43:37 [ 565 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:43:37 [ 565 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:43:37 [ 565 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:43:37 [ 565 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:43:37 [ 565 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:23 [ 565 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:45:23 [ 565 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling remote_proxy_node ... Pulling proxy_list_node ... Pulling env_node ... Pulling env_node_no_proxy ... Pulling remote_proxy_node_no_proxy ... Pulling resolver ... Pulling proxy_list_node_no_proxy ... Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node_no_proxy ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... done Pulling remote_proxy_node_no_proxy ... done Pulling proxy_list_node_no_proxy ... done Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling env_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling env_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling env_node ... digest: sha256:2ea9da862c215fd684... Pulling env_node ... status: image is up to date for a... Pulling proxy1 ... done Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node ... status: image is up to date for a... Pulling env_node ... done Pulling remote_proxy_node ... done Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling env_node_no_proxy ... status: image is up to date for a... Pulling env_node_no_proxy ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:45:26 [ 565 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:08 [ 565 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:47:08 [ 565 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling proxy_list_node ... Pulling env_node_no_proxy ... Pulling env_node ... Pulling remote_proxy_node_no_proxy ... Pulling proxy_list_node_no_proxy ... Pulling remote_proxy_node ... Pulling env_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling env_node ... digest: sha256:2ea9da862c215fd684... Pulling env_node ... status: image is up to date for a... Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node ... status: image is up to date for a... Pulling env_node ... done Pulling proxy_list_node ... done Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node_no_proxy ... done Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling env_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling env_node_no_proxy ... status: image is up to date for a... Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... Pulling env_node_no_proxy ... done Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... Pulling remote_proxy_node_no_proxy ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:47:11 [ 565 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:52 [ 565 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:52 [ 565 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling env_node_no_proxy ... Pulling remote_proxy_node ... Pulling env_node ... Pulling proxy_list_node ... Pulling remote_proxy_node_no_proxy ... Pulling proxy_list_node_no_proxy ... Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... Pulling env_node_no_proxy ... pulling from altinityinfra/integr... Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node_no_proxy ... status: image is up to date for a... Pulling remote_proxy_node_no_proxy ... done Pulling proxy_list_node_no_proxy ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling env_node_no_proxy ... status: image is up to date for a... Pulling env_node_no_proxy ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling env_node ... pulling from altinityinfra/integr... Pulling env_node ... digest: sha256:2ea9da862c215fd684... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:56 [ 565 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 565 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:37 [ 565 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling proxy_list_node ... Pulling proxy_list_node_no_proxy ... Pulling env_node_no_proxy ... Pulling env_node ... Pulling remote_proxy_node ... Pulling remote_proxy_node_no_proxy ... Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... Pulling env_node_no_proxy ... pulling from altinityinfra/integr... Pulling env_node ... pulling from altinityinfra/integr... Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node_no_proxy ... done Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling env_node_no_proxy ... status: image is up to date for a... Pulling env_node ... digest: sha256:2ea9da862c215fd684... Pulling env_node ... status: image is up to date for a... Pulling env_node_no_proxy ... done Pulling env_node ... done Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... Pulling remote_proxy_node_no_proxy ... done Pulling minio1 ... error Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:41 [ 565 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling env_node_no_proxy ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:52:24 [ 565 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:52:24 [ 565 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling proxy_list_node ... Pulling env_node_no_proxy ... Pulling remote_proxy_node ... Pulling env_node ... Pulling remote_proxy_node_no_proxy ... Pulling proxy_list_node_no_proxy ... Pulling env_node ... pulling from altinityinfra/integr... Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node_no_proxy ... done Pulling env_node ... digest: sha256:2ea9da862c215fd684... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node_no_proxy ... done Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling env_node_no_proxy ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... Pulling env_node_no_proxy ... status: image is up to date for a... Pulling env_node_no_proxy ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:52:24 [ 565 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:52:24 [ 565 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:52:24 [ 565 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:52:24 [ 565 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy_gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:52:25 [ 565 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy_gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:52:25 [ 565 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy_gw5 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:52:25 [ 565 ] DEBUG : Command:docker container list --all --filter name='^/roottests3tablefunctionwithhttpsproxy_gw5_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:52:25 [ 565 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : No running containers for project: roottests3tablefunctionwithhttpsproxy_gw5 (cluster.py:904, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:52:25 [ 565 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:52:25 [ 565 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:52:25 [ 565 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy_gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:52:25 [ 565 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy_gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:52:25 [ 565 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy_gw5 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:52:25 [ 565 ] DEBUG : Command:docker container list --all --filter name='^/roottests3tablefunctionwithhttpsproxy_gw5_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:52:25 [ 565 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : No running containers for project: roottests3tablefunctionwithhttpsproxy_gw5 (cluster.py:904, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:52:25 [ 565 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:52:25 [ 565 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ____________________ ERROR at setup of test_read_new_format ____________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_s3_with_https_env_proxy ________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "remote_proxy_node_no_proxy", main_configs=[ "configs/config.d/proxy_remote_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node_no_proxy", main_configs=[ "configs/config.d/proxy_list_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) cluster.add_instance( "env_node_no_proxy", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", "no_proxy": "not_important_host,, minio1 ,", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:79: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling proxy_list_node ... E Pulling env_node_no_proxy ... E Pulling remote_proxy_node ... E Pulling env_node ... E Pulling remote_proxy_node_no_proxy ... E Pulling proxy_list_node_no_proxy ... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node_no_proxy ... done E Pulling env_node ... digest: sha256:2ea9da862c215fd684... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... done E Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling env_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling env_node_no_proxy ... status: image is up to date for a... E Pulling env_node_no_proxy ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case0] ___________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_s3_with_https_proxy_list ________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "remote_proxy_node_no_proxy", main_configs=[ "configs/config.d/proxy_remote_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node_no_proxy", main_configs=[ "configs/config.d/proxy_list_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) cluster.add_instance( "env_node_no_proxy", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", "no_proxy": "not_important_host,, minio1 ,", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:79: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling proxy_list_node ... E Pulling env_node_no_proxy ... E Pulling remote_proxy_node ... E Pulling env_node ... E Pulling remote_proxy_node_no_proxy ... E Pulling proxy_list_node_no_proxy ... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node_no_proxy ... done E Pulling env_node ... digest: sha256:2ea9da862c215fd684... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... done E Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling env_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling env_node_no_proxy ... status: image is up to date for a... E Pulling env_node_no_proxy ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case1] ___________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_s3_with_https_proxy_list_no_proxy ___________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "remote_proxy_node_no_proxy", main_configs=[ "configs/config.d/proxy_remote_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node_no_proxy", main_configs=[ "configs/config.d/proxy_list_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) cluster.add_instance( "env_node_no_proxy", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", "no_proxy": "not_important_host,, minio1 ,", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:79: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling proxy_list_node ... E Pulling env_node_no_proxy ... E Pulling remote_proxy_node ... E Pulling env_node ... E Pulling remote_proxy_node_no_proxy ... E Pulling proxy_list_node_no_proxy ... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node_no_proxy ... done E Pulling env_node ... digest: sha256:2ea9da862c215fd684... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... done E Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling env_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling env_node_no_proxy ... status: image is up to date for a... E Pulling env_node_no_proxy ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case2] ___________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_s3_with_https_remote_no_proxy _____________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "remote_proxy_node_no_proxy", main_configs=[ "configs/config.d/proxy_remote_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node_no_proxy", main_configs=[ "configs/config.d/proxy_list_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) cluster.add_instance( "env_node_no_proxy", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", "no_proxy": "not_important_host,, minio1 ,", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:79: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling proxy_list_node ... E Pulling env_node_no_proxy ... E Pulling remote_proxy_node ... E Pulling env_node ... E Pulling remote_proxy_node_no_proxy ... E Pulling proxy_list_node_no_proxy ... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node_no_proxy ... done E Pulling env_node ... digest: sha256:2ea9da862c215fd684... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... done E Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling env_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling env_node_no_proxy ... status: image is up to date for a... E Pulling env_node_no_proxy ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case3] ___________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_s3_with_https_remote_proxy _______________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "remote_proxy_node_no_proxy", main_configs=[ "configs/config.d/proxy_remote_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "proxy_list_node_no_proxy", main_configs=[ "configs/config.d/proxy_list_no_proxy.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) cluster.add_instance( "env_node_no_proxy", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", "no_proxy": "not_important_host,, minio1 ,", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:79: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy_gw5', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0_gw5/env_node_no_proxy/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling proxy_list_node ... E Pulling env_node_no_proxy ... E Pulling remote_proxy_node ... E Pulling env_node ... E Pulling remote_proxy_node_no_proxy ... E Pulling proxy_list_node_no_proxy ... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy_list_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node_no_proxy ... done E Pulling env_node ... digest: sha256:2ea9da862c215fd684... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling remote_proxy_node_no_proxy ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node_no_proxy ... status: image is up to date for a... E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node_no_proxy ... done E Pulling remote_proxy_node ... digest: sha256:2ea9da862c215fd684... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling proxy_list_node ... digest: sha256:2ea9da862c215fd684... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling env_node_no_proxy ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling env_node_no_proxy ... digest: sha256:2ea9da862c215fd684... E Pulling env_node_no_proxy ... status: image is up to date for a... E Pulling env_node_no_proxy ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case4] ___________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_write_new_format ____________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility_gw3', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0_gw3/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling switching_node ... digest: sha256:2ea9da862c215fd684... E Pulling switching_node ... status: image is up to date for a... E Pulling switching_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling new_node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling new_node ... digest: sha256:2ea9da862c215fd684... E Pulling new_node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling new_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_drop_after_fetch ____________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/storage_conf.xml"], with_minio=True, with_zookeeper=True, ) > cluster.start() test_replicated_s3_zero_copy_drop_partition/test.py:25: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling zoo3 ... E Pulling node1 ... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node1 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo1 ... Pulling minio1 ... Pulling zoo3 ... Pulling node1 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:44:56 [ 568 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:44:56 [ 568 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 16:44:56 [ 568 ] DEBUG : Cluster name: project_name:roottestreplicateds3zerocopydroppartition_gw6. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:44:56 [ 568 ] INFO : Running tests in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/test.py (cluster.py:2790, start) 2026-09-30 16:44:56 [ 568 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:44:56 [ 568 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:44:56 [ 568 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:44:56 [ 568 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:44:56 [ 568 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:44:56 [ 568 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:44:56 [ 568 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:44:56 [ 568 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:44:56 [ 568 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:44:56 [ 568 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:44:56 [ 568 ] DEBUG : No running containers for project: roottestreplicateds3zerocopydroppartition_gw6 (cluster.py:904, cleanup) 2026-09-30 16:44:56 [ 568 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:44:56 [ 568 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:44:56 [ 568 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:44:56 [ 568 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:44:56 [ 568 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 16:44:56 [ 568 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/database (cluster.py:4653, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/logs (cluster.py:4664, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:44:56 [ 568 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env (cluster.py:86, _create_env_file) 2026-09-30 16:44:56 [ 568 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:44:56 [ 568 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:44:56 [ 568 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:44:56 [ 568 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:44:56 [ 568 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:44:56 [ 568 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 568 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:46:26 [ 568 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo1 ... Pulling zoo2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:46:28 [ 568 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:50 [ 568 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:47:50 [ 568 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling zoo2 ... Pulling node1 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:47:52 [ 568 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:23 [ 568 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:49:23 [ 568 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy2 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:49:27 [ 568 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:47 [ 568 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:47 [ 568 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo2 ... Pulling proxy1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:51 [ 568 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:52:35 [ 568 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo1 ... Pulling minio1 ... Pulling zoo3 ... Pulling node1 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:52:35 [ 568 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:52:35 [ 568 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:52:35 [ 568 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:52:35 [ 568 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:52:35 [ 568 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:52:35 [ 568 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : No running containers for project: roottestreplicateds3zerocopydroppartition_gw6 (cluster.py:904, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:52:35 [ 568 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:52:35 [ 568 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:52:35 [ 568 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:52:35 [ 568 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:52:35 [ 568 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : No running containers for project: roottestreplicateds3zerocopydroppartition_gw6 (cluster.py:904, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:52:35 [ 568 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:52:35 [ 568 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _________________ ERROR at setup of test_drop_complex_columns __________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/storage_conf.xml"], with_minio=True, with_zookeeper=True, ) > cluster.start() test_replicated_s3_zero_copy_drop_partition/test.py:25: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition_gw6', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0_gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling zoo3 ... E Pulling node1 ... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node1 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________ ERROR at setup of test_replicated_db_and_ttl _________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/node1_macro.xml"], user_configs=[ "configs/enable_parallel_replicas.xml", ], with_minio=True, with_zookeeper=True, ) > cluster.start() test_replicated_merge_tree_replicated_db_ttl/test.py:29: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:46:50 [ 553 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:46:50 [ 553 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 16:46:50 [ 553 ] DEBUG : Cluster name: project_name:roottestreplicatedmergetreereplicateddbttl_gw1. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:46:50 [ 553 ] INFO : Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/test.py (cluster.py:2790, start) 2026-09-30 16:46:50 [ 553 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:46:50 [ 553 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl_gw1 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:50 [ 553 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl_gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:50 [ 553 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl_gw1 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:50 [ 553 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:50 [ 553 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl_gw1 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:50 [ 553 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl_gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:50 [ 553 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl_gw1 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:50 [ 553 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl_gw1_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:50 [ 553 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:50 [ 553 ] DEBUG : No running containers for project: roottestreplicatedmergetreereplicateddbttl_gw1 (cluster.py:904, cleanup) 2026-09-30 16:46:50 [ 553 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:50 [ 553 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:50 [ 553 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:50 [ 553 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:50 [ 553 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 16:46:50 [ 553 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/configs/node1_macro.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/database (cluster.py:4653, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/logs (cluster.py:4664, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:46:50 [ 553 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env (cluster.py:86, _create_env_file) 2026-09-30 16:46:50 [ 553 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:50 [ 553 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:50 [ 553 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:50 [ 553 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:50 [ 553 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:46:50 [ 553 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:32 [ 553 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:32 [ 553 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:33 [ 553 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:05 [ 553 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:05 [ 553 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo1 ... Pulling node1 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:07 [ 553 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:43 [ 553 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:51:43 [ 553 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo3 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... done Pulling proxy2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:51:46 [ 553 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:17 [ 553 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:53:17 [ 553 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo3 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:53:21 [ 553 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:55:15 [ 553 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl_gw1', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0_gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:55:15 [ 553 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:55:15 [ 553 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:55:15 [ 553 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl_gw1 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:55:15 [ 553 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl_gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:55:15 [ 553 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl_gw1 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:55:15 [ 553 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl_gw1_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : No running containers for project: roottestreplicatedmergetreereplicateddbttl_gw1 (cluster.py:904, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:55:15 [ 553 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:55:15 [ 553 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl_gw1 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:55:15 [ 553 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl_gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:55:15 [ 553 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl_gw1 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:55:15 [ 553 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl_gw1_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : No running containers for project: roottestreplicatedmergetreereplicateddbttl_gw1 (cluster.py:904, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:55:15 [ 553 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:55:15 [ 553 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ____________________ ERROR at setup of test_commit_on_limit ____________________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_azurite=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) cluster.add_instance( "instance_too_many_parts", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", "configs/merge_tree.xml", ], stay_alive=True, ) cluster.add_instance( "instance_24.5", with_zookeeper=True, image="clickhouse/clickhouse-server", tag="24.5", stay_alive=True, user_configs=[ "configs/users.xml", ], with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling azurite1 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling old_instance ... E Pulling instance_24.5 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling instance_too_many_parts ... E Pulling instance ... E Pulling instance2 ... E Pulling resolver ... E Pulling instance_24.5 ... pulling from clickhouse/clickhous... E Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... E Pulling instance_24.5 ... status: image is up to date for c... E Pulling instance_24.5 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling azurite1 ... pulling from altinityinfra/azurite E Pulling azurite1 ... digest: sha256:dae2a5f96553962901... E Pulling azurite1 ... status: image is up to date for a... E Pulling azurite1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling instance ... digest: sha256:2ea9da862c215fd684... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E Pulling resolver ... pulling from altinityinfra/python... E Pulling instance_too_many_parts ... pulling from altinityinfra/integr... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling instance2 ... digest: sha256:2ea9da862c215fd684... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... E Pulling instance_too_many_parts ... status: image is up to date for a... E Pulling instance_too_many_parts ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling azurite1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling zoo3 ... Pulling old_instance ... Pulling instance_24.5 ... Pulling proxy1 ... Pulling minio1 ... Pulling instance_too_many_parts ... Pulling instance ... Pulling instance2 ... Pulling resolver ... Pulling instance_24.5 ... pulling from clickhouse/clickhous... Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... Pulling instance_24.5 ... status: image is up to date for c... Pulling instance_24.5 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling azurite1 ... pulling from altinityinfra/azurite Pulling azurite1 ... digest: sha256:dae2a5f96553962901... Pulling azurite1 ... status: image is up to date for a... Pulling azurite1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling old_instance ... pulling from clickhouse/clickhous... Pulling proxy2 ... done Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling instance ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling instance ... digest: sha256:2ea9da862c215fd684... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling instance_too_many_parts ... pulling from altinityinfra/integr... Pulling instance2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling instance2 ... digest: sha256:2ea9da862c215fd684... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... Pulling instance_too_many_parts ... status: image is up to date for a... Pulling instance_too_many_parts ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV HOSTNAME b5ab15b2a465 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' test_part_uuid/test.py::test_part_uuid test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_replica/test.py::test_choose_source_replica test_recovery_replica/test.py::test_recovery test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update test_storage_s3_queue/test.py::test_commit_on_limit 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered]' -vvv (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID fab65bf9afe2472dba8da715b12a1bd6 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PYTEST_XDIST_WORKER gw7 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : ENV PYTEST_CURRENT_TEST test_storage_s3_queue/test.py::test_commit_on_limit (setup) (cluster.py:446, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:44:48 [ 586 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 16:44:48 [ 586 ] DEBUG : Cluster name: project_name:rootteststorages3queue_gw7. Added instance name:instance tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : Cluster name: project_name:rootteststorages3queue_gw7. Added instance name:instance2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : Cluster name: project_name:rootteststorages3queue_gw7. Added instance name:old_instance tag:23.12 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : Cluster name: project_name:rootteststorages3queue_gw7. Added instance name:instance_too_many_parts tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:44:48 [ 586 ] DEBUG : Cluster name: project_name:rootteststorages3queue_gw7. Added instance name:instance_24.5 tag:24.5 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:44:48 [ 586 ] INFO : Starting cluster... (test.py:143, started_cluster) 2026-09-30 16:44:48 [ 586 ] INFO : Running tests in /ClickHouse/tests/integration/test_storage_s3_queue/test.py (cluster.py:2790, start) 2026-09-30 16:44:48 [ 586 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:44:48 [ 586 ] DEBUG : Docker networks for project rootteststorages3queue_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:44:48 [ 586 ] DEBUG : Docker containers for project rootteststorages3queue_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:44:48 [ 586 ] DEBUG : Docker volumes for project rootteststorages3queue_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:44:48 [ 586 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:44:49 [ 586 ] DEBUG : Docker networks for project rootteststorages3queue_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:44:49 [ 586 ] DEBUG : Docker containers for project rootteststorages3queue_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:44:49 [ 586 ] DEBUG : Docker volumes for project rootteststorages3queue_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:44:49 [ 586 ] DEBUG : Command:docker container list --all --filter name='^/rootteststorages3queue_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:44:49 [ 586 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:44:49 [ 586 ] DEBUG : No running containers for project: rootteststorages3queue_gw7 (cluster.py:904, cleanup) 2026-09-30 16:44:49 [ 586 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:44:49 [ 586 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:44:49 [ 586 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:44:49 [ 586 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup directory for instance: instance (cluster.py:2810, start) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_s3_queue/configs/zookeeper.xml', '/ClickHouse/tests/integration/test_storage_s3_queue/configs/s3queue_log.xml'] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/database (cluster.py:4653, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/logs (cluster.py:4664, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup directory for instance: instance2 (cluster.py:2810, start) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_s3_queue/configs/s3queue_log.xml'] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/database (cluster.py:4653, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/logs (cluster.py:4664, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup directory for instance: old_instance (cluster.py:2810, start) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/database (cluster.py:4653, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/logs (cluster.py:4664, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup directory for instance: instance_too_many_parts (cluster.py:2810, start) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_s3_queue/configs/s3queue_log.xml', '/ClickHouse/tests/integration/test_storage_s3_queue/configs/merge_tree.xml'] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/database (cluster.py:4653, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/logs (cluster.py:4664, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup directory for instance: instance_24.5 (cluster.py:2810, start) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/database (cluster.py:4653, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/logs (cluster.py:4664, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:44:49 [ 586 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/minio/certs/public.crt', 'AZURITE_PORT': '30351', 'AZURITE_STORAGE_ACCOUNT_URL': 'http://azurite1:30351/devstoreaccount1', 'AZURITE_CONNECTION_STRING': 'DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30351/devstoreaccount1;'} stored in /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env (cluster.py:86, _create_env_file) 2026-09-30 16:44:49 [ 586 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:44:49 [ 586 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:44:49 [ 586 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:44:49 [ 586 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:44:49 [ 586 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:44:49 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (1.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (1.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (34.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (76.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (1.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (28.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (55.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (84.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (1.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (53.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (92.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (66.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (1.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (0.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (8.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (13.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (22.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (31.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (39.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (47.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (57.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (65.5%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (74.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (82.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (91.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (0.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (9.3%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (16.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (22.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (28.3%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (34.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (38.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (44.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (50.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (55.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (62.3%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (70.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (77.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (84.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (92.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (96.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (97.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (99.5%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (3.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... pulling from altinityinfra/azurite (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... digest: sha256:dae2a5f96553962901... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... status: downloaded newer image fo... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (1.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (1.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (35.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (77.3%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (1.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (32.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (66.5%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (89.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (1.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (57.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (94.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (1.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (14.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (0.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (3.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (7.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (11.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (15.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (20.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (23.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (27.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (31.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (35.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (39.5%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (43.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (47.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (52.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (56.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (60.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (65.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (69.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (73.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (77.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (81.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (85.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (90.3%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (94.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (98.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (0.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (5.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (8.5%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (11.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (14.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (17.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (19.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (22.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (25.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (27.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (31.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (34.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (38.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (42.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (45.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (46.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (47.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (47.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (48.7%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (50.9%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (56.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (59.4%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (62.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (66.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (70.5%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (74.3%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (76.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (80.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (84.2%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (87.6%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (91.3%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (95.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (99.1%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (3.8%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... status: downloaded newer image fo... (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:01 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:01 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling proxy2 ... Pulling zoo1 ... Pulling old_instance ... Pulling proxy1 ... Pulling instance_24.5 ... Pulling azurite1 ... Pulling minio1 ... Pulling instance_too_many_parts ... Pulling instance2 ... Pulling instance ... Pulling resolver ... Pulling instance2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling instance2 ... digest: sha256:2ea9da862c215fd684... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling instance_24.5 ... pulling from clickhouse/clickhous... Pulling old_instance ... pulling from clickhouse/clickhous... Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... waiting Pulling instance_24.5 ... waiting Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... pulling fs layer Pulling instance_24.5 ... waiting Pulling instance_24.5 ... waiting Pulling instance_24.5 ... waiting Pulling instance_24.5 ... waiting Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... waiting Pulling old_instance ... pulling fs layer Pulling old_instance ... waiting Pulling old_instance ... pulling fs layer Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling instance_24.5 ... downloading (100.0%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... downloading (1.1%) Pulling instance_24.5 ... downloading (1.0%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... downloading (34.8%) Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling instance_24.5 ... downloading (76.8%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... extracting (1.1%) Pulling instance_24.5 ... extracting (28.9%) Pulling instance_24.5 ... extracting (55.7%) Pulling instance_24.5 ... extracting (84.7%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... extracting (1.1%) Pulling instance_24.5 ... extracting (53.7%) Pulling instance_24.5 ... extracting (92.9%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... pull complete Pulling minio1 ... error Pulling instance_24.5 ... downloading (66.7%) Pulling instance_24.5 ... downloading (100.0%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... downloading (1.9%) Pulling instance_24.5 ... download complete Pulling instance_24.5 ... downloading (0.4%) Pulling instance_24.5 ... downloading (8.2%) Pulling instance_24.5 ... downloading (13.6%) Pulling instance_24.5 ... downloading (22.1%) Pulling instance_24.5 ... downloading (31.0%) Pulling instance_24.5 ... downloading (39.2%) Pulling instance_24.5 ... downloading (47.7%) Pulling instance_24.5 ... downloading (57.4%) Pulling instance_24.5 ... downloading (65.5%) Pulling instance_24.5 ... downloading (74.0%) Pulling instance_24.5 ... downloading (82.9%) Pulling instance_24.5 ... downloading (91.1%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... extracting (0.4%) Pulling instance_24.5 ... extracting (9.3%) Pulling instance_24.5 ... extracting (16.2%) Pulling instance_24.5 ... extracting (22.6%) Pulling instance_24.5 ... extracting (28.3%) Pulling instance_24.5 ... extracting (34.0%) Pulling instance_24.5 ... extracting (38.8%) Pulling instance_24.5 ... extracting (44.9%) Pulling instance_24.5 ... extracting (50.6%) Pulling instance_24.5 ... extracting (55.4%) Pulling instance_24.5 ... extracting (62.3%) Pulling instance_24.5 ... extracting (70.0%) Pulling instance_24.5 ... extracting (77.7%) Pulling instance_24.5 ... extracting (84.9%) Pulling instance_24.5 ... extracting (92.2%) Pulling instance_24.5 ... extracting (96.7%) Pulling instance_24.5 ... extracting (97.9%) Pulling instance_24.5 ... extracting (99.5%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... extracting (3.8%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... downloading (100.0%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... downloading (100.0%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... downloading (100.0%) Pulling instance_24.5 ... verifying checksum Pulling instance_24.5 ... download complete Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... extracting (100.0%) Pulling azurite1 ... pulling from altinityinfra/azurite Pulling azurite1 ... digest: sha256:dae2a5f96553962901... Pulling azurite1 ... status: image is up to date for a... Pulling azurite1 ... done Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... extracting (100.0%) Pulling instance_24.5 ... extracting (100.0%) Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling instance_24.5 ... pull complete Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... Pulling instance_24.5 ... status: downloaded newer image fo... Pulling instance_24.5 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (1.1%) Pulling old_instance ... downloading (1.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (35.0%) Pulling old_instance ... downloading (77.3%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... extracting (1.1%) Pulling old_instance ... extracting (32.2%) Pulling old_instance ... extracting (66.5%) Pulling old_instance ... extracting (89.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (1.1%) Pulling old_instance ... extracting (57.1%) Pulling old_instance ... extracting (94.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... downloading (1.9%) Pulling old_instance ... downloading (14.7%) Pulling old_instance ... download complete Pulling old_instance ... downloading (0.2%) Pulling old_instance ... download complete Pulling old_instance ... downloading (3.6%) Pulling old_instance ... downloading (7.6%) Pulling old_instance ... downloading (11.6%) Pulling instance ... pulling from altinityinfra/integr... Pulling instance ... digest: sha256:2ea9da862c215fd684... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling old_instance ... downloading (15.8%) Pulling instance_too_many_parts ... pulling from altinityinfra/integr... Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... Pulling instance_too_many_parts ... status: image is up to date for a... Pulling instance_too_many_parts ... done Pulling old_instance ... downloading (20.0%) Pulling old_instance ... downloading (23.9%) Pulling old_instance ... downloading (27.9%) Pulling old_instance ... downloading (31.9%) Pulling old_instance ... downloading (35.7%) Pulling old_instance ... downloading (39.5%) Pulling old_instance ... downloading (43.7%) Pulling old_instance ... downloading (47.9%) Pulling old_instance ... downloading (52.1%) Pulling old_instance ... downloading (56.2%) Pulling old_instance ... downloading (60.6%) Pulling old_instance ... downloading (65.2%) Pulling old_instance ... downloading (69.4%) Pulling old_instance ... downloading (73.7%) Pulling old_instance ... downloading (77.7%) Pulling old_instance ... downloading (81.9%) Pulling old_instance ... downloading (85.9%) Pulling old_instance ... downloading (90.3%) Pulling old_instance ... downloading (94.7%) Pulling old_instance ... downloading (98.8%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... extracting (0.2%) Pulling old_instance ... extracting (5.0%) Pulling old_instance ... extracting (8.5%) Pulling old_instance ... extracting (11.7%) Pulling old_instance ... extracting (14.7%) Pulling old_instance ... extracting (17.0%) Pulling old_instance ... extracting (19.6%) Pulling old_instance ... extracting (22.6%) Pulling old_instance ... extracting (25.2%) Pulling old_instance ... extracting (27.7%) Pulling old_instance ... extracting (31.1%) Pulling old_instance ... extracting (34.9%) Pulling old_instance ... extracting (38.6%) Pulling old_instance ... extracting (42.4%) Pulling old_instance ... extracting (45.0%) Pulling old_instance ... extracting (46.4%) Pulling old_instance ... extracting (47.2%) Pulling old_instance ... extracting (47.7%) Pulling old_instance ... extracting (48.7%) Pulling old_instance ... extracting (50.9%) Pulling old_instance ... extracting (56.1%) Pulling old_instance ... extracting (59.4%) Pulling old_instance ... extracting (62.8%) Pulling old_instance ... extracting (66.6%) Pulling old_instance ... extracting (70.5%) Pulling old_instance ... extracting (74.3%) Pulling old_instance ... extracting (76.1%) Pulling old_instance ... extracting (80.8%) Pulling old_instance ... extracting (84.2%) Pulling old_instance ... extracting (87.6%) Pulling old_instance ... extracting (91.3%) Pulling old_instance ... extracting (95.1%) Pulling old_instance ... extracting (99.1%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (3.8%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: downloaded newer image fo... Pulling old_instance ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:03 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... pulling from altinityinfra/azurite (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... digest: sha256:dae2a5f96553962901... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:37 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:37 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling azurite1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo3 ... Pulling instance_too_many_parts ... Pulling instance_24.5 ... Pulling instance ... Pulling old_instance ... Pulling instance2 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... done Pulling instance_too_many_parts ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... Pulling instance_too_many_parts ... status: image is up to date for a... Pulling instance_24.5 ... pulling from clickhouse/clickhous... Pulling instance_too_many_parts ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... Pulling instance_24.5 ... status: image is up to date for c... Pulling instance_24.5 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling old_instance ... pulling from clickhouse/clickhous... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling instance ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling azurite1 ... pulling from altinityinfra/azurite Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling azurite1 ... digest: sha256:dae2a5f96553962901... Pulling azurite1 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling azurite1 ... done Pulling zoo1 ... done Pulling instance ... digest: sha256:2ea9da862c215fd684... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling instance2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling instance2 ... digest: sha256:2ea9da862c215fd684... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:40 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... pulling from altinityinfra/azurite (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... digest: sha256:dae2a5f96553962901... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:07 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:53:07 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling azurite1 ... Pulling zoo2 ... Pulling zoo1 ... Pulling old_instance ... Pulling instance_24.5 ... Pulling proxy2 ... Pulling minio1 ... Pulling instance2 ... Pulling instance_too_many_parts ... Pulling instance ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling azurite1 ... pulling from altinityinfra/azurite Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling azurite1 ... digest: sha256:dae2a5f96553962901... Pulling azurite1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling azurite1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling instance_too_many_parts ... pulling from altinityinfra/integr... Pulling zoo2 ... done Pulling instance ... pulling from altinityinfra/integr... Pulling instance2 ... pulling from altinityinfra/integr... Pulling instance_24.5 ... pulling from clickhouse/clickhous... Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... Pulling instance_too_many_parts ... status: image is up to date for a... Pulling instance_too_many_parts ... done Pulling instance ... digest: sha256:2ea9da862c215fd684... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... Pulling instance_24.5 ... status: image is up to date for c... Pulling instance2 ... digest: sha256:2ea9da862c215fd684... Pulling instance2 ... status: image is up to date for a... Pulling instance_24.5 ... done Pulling instance2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling old_instance ... pulling from clickhouse/clickhous... Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:53:10 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... pulling from altinityinfra/azurite (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... digest: sha256:dae2a5f96553962901... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:47 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:55:47 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling zoo3 ... Pulling zoo1 ... Pulling old_instance ... Pulling minio1 ... Pulling instance_too_many_parts ... Pulling instance2 ... Pulling instance_24.5 ... Pulling azurite1 ... Pulling instance ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling old_instance ... pulling from clickhouse/clickhous... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling instance2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling azurite1 ... pulling from altinityinfra/azurite Pulling azurite1 ... digest: sha256:dae2a5f96553962901... Pulling azurite1 ... status: image is up to date for a... Pulling instance ... pulling from altinityinfra/integr... Pulling azurite1 ... done Pulling instance2 ... digest: sha256:2ea9da862c215fd684... Pulling instance2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling instance2 ... done Pulling zoo3 ... done Pulling instance ... digest: sha256:2ea9da862c215fd684... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling instance_too_many_parts ... pulling from altinityinfra/integr... Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... Pulling instance_too_many_parts ... status: image is up to date for a... Pulling instance_too_many_parts ... done Pulling resolver ... pulling from altinityinfra/python... Pulling instance_24.5 ... pulling from clickhouse/clickhous... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... Pulling instance_24.5 ... status: image is up to date for c... Pulling instance_24.5 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:55:50 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_24.5 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... pulling from altinityinfra/azurite (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... digest: sha256:dae2a5f96553962901... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling azurite1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:Pulling instance_too_many_parts ... done (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:58:26 [ 586 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling azurite1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling zoo3 ... Pulling old_instance ... Pulling instance_24.5 ... Pulling proxy1 ... Pulling minio1 ... Pulling instance_too_many_parts ... Pulling instance ... Pulling instance2 ... Pulling resolver ... Pulling instance_24.5 ... pulling from clickhouse/clickhous... Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... Pulling instance_24.5 ... status: image is up to date for c... Pulling instance_24.5 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling azurite1 ... pulling from altinityinfra/azurite Pulling azurite1 ... digest: sha256:dae2a5f96553962901... Pulling azurite1 ... status: image is up to date for a... Pulling azurite1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling old_instance ... pulling from clickhouse/clickhous... Pulling proxy2 ... done Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling instance ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling instance ... digest: sha256:2ea9da862c215fd684... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling instance_too_many_parts ... pulling from altinityinfra/integr... Pulling instance2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling instance2 ... digest: sha256:2ea9da862c215fd684... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... Pulling instance_too_many_parts ... status: image is up to date for a... Pulling instance_too_many_parts ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:58:26 [ 586 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:58:26 [ 586 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:58:26 [ 586 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Docker networks for project rootteststorages3queue_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:58:26 [ 586 ] DEBUG : Docker containers for project rootteststorages3queue_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:58:26 [ 586 ] DEBUG : Docker volumes for project rootteststorages3queue_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:58:26 [ 586 ] DEBUG : Command:docker container list --all --filter name='^/rootteststorages3queue_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : No running containers for project: rootteststorages3queue_gw7 (cluster.py:904, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:58:26 [ 586 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:58:26 [ 586 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Docker networks for project rootteststorages3queue_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:58:26 [ 586 ] DEBUG : Docker containers for project rootteststorages3queue_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:58:26 [ 586 ] DEBUG : Docker volumes for project rootteststorages3queue_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:58:26 [ 586 ] DEBUG : Command:docker container list --all --filter name='^/rootteststorages3queue_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : No running containers for project: rootteststorages3queue_gw7 (cluster.py:904, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:58:26 [ 586 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:58:26 [ 586 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ______ ERROR at setup of test_delete_after_processing[AzureQueue-ordered] ______ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_azurite=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) cluster.add_instance( "instance_too_many_parts", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", "configs/merge_tree.xml", ], stay_alive=True, ) cluster.add_instance( "instance_24.5", with_zookeeper=True, image="clickhouse/clickhouse-server", tag="24.5", stay_alive=True, user_configs=[ "configs/users.xml", ], with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling azurite1 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling old_instance ... E Pulling instance_24.5 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling instance_too_many_parts ... E Pulling instance ... E Pulling instance2 ... E Pulling resolver ... E Pulling instance_24.5 ... pulling from clickhouse/clickhous... E Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... E Pulling instance_24.5 ... status: image is up to date for c... E Pulling instance_24.5 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling azurite1 ... pulling from altinityinfra/azurite E Pulling azurite1 ... digest: sha256:dae2a5f96553962901... E Pulling azurite1 ... status: image is up to date for a... E Pulling azurite1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling instance ... digest: sha256:2ea9da862c215fd684... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E Pulling resolver ... pulling from altinityinfra/python... E Pulling instance_too_many_parts ... pulling from altinityinfra/integr... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling instance2 ... digest: sha256:2ea9da862c215fd684... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... E Pulling instance_too_many_parts ... status: image is up to date for a... E Pulling instance_too_many_parts ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_delete_after_processing[AzureQueue-unordered] _____ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_azurite=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) cluster.add_instance( "instance_too_many_parts", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", "configs/merge_tree.xml", ], stay_alive=True, ) cluster.add_instance( "instance_24.5", with_zookeeper=True, image="clickhouse/clickhouse-server", tag="24.5", stay_alive=True, user_configs=[ "configs/users.xml", ], with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling azurite1 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling old_instance ... E Pulling instance_24.5 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling instance_too_many_parts ... E Pulling instance ... E Pulling instance2 ... E Pulling resolver ... E Pulling instance_24.5 ... pulling from clickhouse/clickhous... E Pulling instance_24.5 ... digest: sha256:f1155aa4adec32964c... E Pulling instance_24.5 ... status: image is up to date for c... E Pulling instance_24.5 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling azurite1 ... pulling from altinityinfra/azurite E Pulling azurite1 ... digest: sha256:dae2a5f96553962901... E Pulling azurite1 ... status: image is up to date for a... E Pulling azurite1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling instance ... digest: sha256:2ea9da862c215fd684... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E Pulling resolver ... pulling from altinityinfra/python... E Pulling instance_too_many_parts ... pulling from altinityinfra/integr... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling instance2 ... digest: sha256:2ea9da862c215fd684... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling instance_too_many_parts ... digest: sha256:2ea9da862c215fd684... E Pulling instance_too_many_parts ... status: image is up to date for a... E Pulling instance_too_many_parts ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ============================== slowest durations =============================== 817.39s setup test_storage_s3_queue/test.py::test_commit_on_limit 527.47s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy 527.34s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 505.52s setup test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 459.33s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 304.80s setup test_storage_hudi/test.py::test_multiple_hudi_files 298.59s setup test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage 108.56s setup test_replace_partition/test.py::test_normal_work 104.06s setup test_recovery_replica/test.py::test_choose_source_replica 65.85s setup test_storage_redis/test.py::test_create_table 61.93s setup test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with 61.20s setup test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] 60.95s setup test_reloading_storage_configuration/test.py::test_add_disk 59.09s setup test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 57.45s setup test_session_log/test.py::test_grpc_session 56.37s setup test_reload_zookeeper/test.py::test_reload_zookeeper 55.58s setup test_rocksdb_options/test.py::test_invalid_block_based_table_options 54.23s setup test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings 52.13s setup test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 48.40s setup test_part_uuid/test.py::test_part_uuid 48.38s setup test_settings_constraints_distributed/test.py::test_insert_clamps_settings 46.10s setup test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side 45.39s setup test_read_temporary_tables_on_failure/test.py::test_different_versions 42.67s setup test_reload_query_masking_rules/test.py::test_reload_query_masking_rules 39.06s setup test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster 22.33s call test_recovery_replica/test.py::test_update_metadata 16.61s call test_reload_zookeeper/test.py::test_reload_zookeeper 12.19s teardown test_reload_zookeeper/test.py::test_reload_zookeeper 11.59s call test_rocksdb_options/test.py::test_table_invalid_options 11.49s call test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 10.79s call test_rocksdb_options/test.py::test_table_invalid_column_family_options 10.42s teardown test_row_policy/test.py::test_with_prewhere 10.31s call test_rocksdb_options/test.py::test_invalid_options 9.28s call test_rocksdb_options/test.py::test_invalid_column_family_options 9.24s call test_row_policy/test.py::test_reload_users_xml_by_timer 9.12s call test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 8.76s call test_rocksdb_options/test.py::test_invalid_block_based_table_options 8.75s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] 8.65s teardown test_recovery_replica/test.py::test_update_metadata 8.45s teardown test_part_uuid/test.py::test_part_uuid 8.17s call test_row_policy/test.py::test_change_of_users_xml_changes_row_policies 6.45s call test_recovery_replica/test.py::test_choose_source_replica 6.41s call test_reloading_storage_configuration/test.py::test_new_policy_works 6.41s call test_row_policy/test.py::test_dcl_introspection 6.39s call test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 6.26s call test_reloading_storage_configuration/test.py::test_remove_disk_from_policy 6.07s teardown test_replace_partition/test.py::test_normal_work 5.94s call test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config 5.94s call test_reloading_storage_configuration/test.py::test_remove_policy 5.87s call test_reloading_storage_configuration/test.py::test_add_disk 5.86s call test_settings_constraints_distributed/test.py::test_select_clamps_settings 5.83s call test_reloading_storage_configuration/test.py::test_update_disk 5.83s call test_reloading_storage_configuration/test.py::test_remove_disk 5.81s call test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 5.78s call test_reloading_storage_configuration/test.py::test_add_volume_to_policy 5.74s call test_reloading_storage_configuration/test.py::test_add_disk_to_policy 5.48s call test_read_temporary_tables_on_failure/test.py::test_different_versions 5.28s call test_reloading_storage_configuration/test.py::test_add_policy 5.12s teardown test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings 5.11s setup test_settings_constraints_distributed/test.py::test_select_clamps_settings 5.11s call test_recovery_replica/test.py::test_recovery 4.98s teardown test_settings_constraints_distributed/test.py::test_select_clamps_settings 4.97s call test_row_policy/test.py::test_grant_create_row_policy 4.88s teardown test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster 4.70s teardown test_read_temporary_tables_on_failure/test.py::test_different_versions 4.65s teardown test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 4.63s teardown test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side 4.63s teardown test_session_log/test.py::test_postgres_session 4.53s call test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with 4.39s call test_part_uuid/test.py::test_part_uuid 4.31s call test_row_policy/test.py::test_some_users_without_policies 4.25s teardown test_storage_redis/test.py::test_update 4.16s call test_row_policy/test.py::test_with_prewhere 3.98s teardown test_reload_query_masking_rules/test.py::test_reload_query_masking_rules 3.84s teardown test_reloading_storage_configuration/test.py::test_update_disk 3.79s call test_row_policy/test.py::test_dcl_management 3.65s call test_row_policy/test.py::test_miscellaneous_engines 3.56s call test_session_log/test.py::test_parallel_sessions 3.45s call test_row_policy/test.py::test_smoke 3.05s call test_row_policy/test.py::test_row_policy_filter_with_subquery 2.96s call test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] 2.86s call test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] 2.81s call test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] 2.75s call test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] 2.75s call test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] 2.71s call test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] 2.48s call test_replace_partition/test.py::test_normal_work 2.41s teardown test_rocksdb_options/test.py::test_valid_options 2.37s call test_settings_constraints_distributed/test.py::test_insert_clamps_settings 2.37s teardown test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 2.35s call test_row_policy/test.py::test_policy_on_distributed_table_via_role 2.23s teardown test_row_policy/test.py::test_dcl_introspection 2.17s teardown test_row_policy/test.py::test_change_of_users_xml_changes_row_policies 2.13s teardown test_row_policy/test.py::test_smoke 2.13s teardown test_row_policy/test.py::test_grant_create_row_policy 2.03s teardown test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned 2.02s teardown test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with 1.99s teardown test_row_policy/test.py::test_reload_users_xml_by_timer 1.99s teardown test_row_policy/test.py::test_policy_on_distributed_table_via_role 1.98s teardown test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml 1.97s teardown test_row_policy/test.py::test_join 1.97s teardown test_row_policy/test.py::test_tags_with_db_and_table_names 1.94s teardown test_row_policy/test.py::test_some_users_without_policies 1.93s teardown test_row_policy/test.py::test_users_xml_is_readonly 1.92s teardown test_row_policy/test.py::test_dcl_management 1.92s teardown test_row_policy/test.py::test_miscellaneous_engines 1.92s teardown test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter 1.92s teardown test_row_policy/test.py::test_row_policy_filter_with_subquery 1.91s teardown test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter 1.89s call test_session_log/test.py::test_grpc_session 1.88s teardown test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data 1.87s teardown test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data 1.87s teardown test_row_policy/test.py::test_introspection 1.85s call test_session_log/test.py::test_postgres_session 1.85s call test_session_log/test.py::test_mysql_session 1.81s call test_storage_redis/test.py::test_create_table 1.68s call test_row_policy/test.py::test_tags_with_db_and_table_names 1.56s call test_storage_redis/test.py::test_simple_insert 1.49s call test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data 1.48s call test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data 1.36s call test_storage_redis/test.py::test_delete 1.29s call test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned 1.24s call test_storage_redis/test.py::test_update 1.18s call test_reload_query_masking_rules/test.py::test_reload_query_masking_rules 1.00s call test_rocksdb_options/test.py::test_valid_options 0.93s call test_storage_redis/test.py::test_truncate 0.88s call test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml 0.86s call test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter 0.82s call test_storage_redis/test.py::test_simple_select 0.76s call test_storage_redis/test.py::test_select_int 0.76s call test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter 0.76s call test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings 0.69s call test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side 0.63s call test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster 0.43s call test_row_policy/test.py::test_join 0.22s call test_rocksdb_options/test.py::test_valid_column_family_options 0.22s call test_rocksdb_options/test.py::test_table_valid_column_family_options 0.22s call test_row_policy/test.py::test_introspection 0.22s call test_rocksdb_options/test.py::test_table_valid_options 0.22s call test_row_policy/test.py::test_users_xml_is_readonly 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_policy 0.00s teardown test_recovery_replica/test.py::test_choose_source_replica 0.00s setup test_reloading_storage_configuration/test.py::test_add_disk_to_policy 0.00s setup test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned 0.00s teardown test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 0.00s teardown test_rocksdb_options/test.py::test_invalid_block_based_table_options 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] 0.00s setup test_recovery_replica/test.py::test_recovery 0.00s setup test_storage_hudi/test.py::test_single_hudi_file 0.00s setup test_row_policy/test.py::test_tags_with_db_and_table_names 0.00s setup test_row_policy/test.py::test_change_of_users_xml_changes_row_policies 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_disk 0.00s teardown test_storage_hudi/test.py::test_multiple_hudi_files 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_disk_from_policy 0.00s teardown test_storage_s3_queue/test.py::test_commit_on_limit 0.00s teardown test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered] 0.00s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy 0.00s setup test_row_policy/test.py::test_grant_create_row_policy 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 0.00s teardown test_reloading_storage_configuration/test.py::test_add_disk 0.00s setup test_row_policy/test.py::test_dcl_introspection 0.00s setup test_rocksdb_options/test.py::test_valid_options 0.00s setup test_row_policy/test.py::test_introspection 0.00s teardown test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 0.00s setup test_rocksdb_options/test.py::test_valid_column_family_options 0.00s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 0.00s setup test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml 0.00s setup test_row_policy/test.py::test_row_policy_filter_with_subquery 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy 0.00s setup test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter 0.00s setup test_row_policy/test.py::test_join 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] 0.00s setup test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter 0.00s teardown test_storage_hudi/test.py::test_types 0.00s setup test_session_log/test.py::test_parallel_sessions 0.00s setup test_row_policy/test.py::test_smoke 0.00s setup test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 0.00s setup test_row_policy/test.py::test_some_users_without_policies 0.00s setup test_row_policy/test.py::test_users_xml_is_readonly 0.00s setup test_row_policy/test.py::test_with_prewhere 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] 0.00s setup test_row_policy/test.py::test_dcl_management 0.00s setup test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data 0.00s setup test_row_policy/test.py::test_miscellaneous_engines 0.00s setup test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data 0.00s setup test_row_policy/test.py::test_reload_users_xml_by_timer 0.00s setup test_storage_redis/test.py::test_simple_select 0.00s teardown test_session_log/test.py::test_grpc_session 0.00s setup test_row_policy/test.py::test_policy_on_distributed_table_via_role 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy 0.00s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy 0.00s setup test_storage_redis/test.py::test_simple_insert 0.00s teardown test_storage_hudi/test.py::test_single_hudi_file 0.00s setup test_reloading_storage_configuration/test.py::test_new_policy_works 0.00s setup test_recovery_replica/test.py::test_update_metadata 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] 0.00s teardown test_session_log/test.py::test_parallel_sessions 0.00s teardown test_settings_constraints_distributed/test.py::test_insert_clamps_settings 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s setup test_reloading_storage_configuration/test.py::test_remove_disk_from_policy 0.00s setup test_storage_hudi/test.py::test_types 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list 0.00s teardown test_storage_redis/test.py::test_simple_insert 0.00s teardown test_storage_redis/test.py::test_create_table 0.00s teardown test_recovery_replica/test.py::test_recovery 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s setup test_session_log/test.py::test_mysql_session 0.00s setup test_rocksdb_options/test.py::test_table_valid_options 0.00s teardown test_rocksdb_options/test.py::test_invalid_options 0.00s setup test_storage_redis/test.py::test_delete 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy 0.00s setup test_reloading_storage_configuration/test.py::test_update_disk 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s teardown test_reloading_storage_configuration/test.py::test_add_disk_to_policy 0.00s teardown test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered] 0.00s teardown test_reloading_storage_configuration/test.py::test_add_volume_to_policy 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy 0.00s setup test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s setup test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config 0.00s setup test_reloading_storage_configuration/test.py::test_remove_policy 0.00s setup test_reloading_storage_configuration/test.py::test_remove_disk 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] 0.00s setup test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s setup test_storage_redis/test.py::test_update 0.00s setup test_storage_redis/test.py::test_select_int 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s teardown test_reloading_storage_configuration/test.py::test_new_policy_works 0.00s teardown test_rocksdb_options/test.py::test_valid_column_family_options 0.00s setup test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_storage_redis/test.py::test_truncate 0.00s setup test_reloading_storage_configuration/test.py::test_add_volume_to_policy 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s setup test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered] 0.00s teardown test_rocksdb_options/test.py::test_table_valid_options 0.00s setup test_rocksdb_options/test.py::test_table_invalid_options 0.00s setup test_session_log/test.py::test_postgres_session 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_options 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy 0.00s setup test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s teardown test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s setup test_reloading_storage_configuration/test.py::test_add_policy 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] 0.00s teardown test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config 0.00s setup test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s teardown test_storage_redis/test.py::test_simple_select 0.00s teardown test_storage_redis/test.py::test_select_int 0.00s teardown test_reloading_storage_configuration/test.py::test_add_policy 0.00s setup test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered] 0.00s teardown test_storage_redis/test.py::test_truncate 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] 0.00s teardown test_session_log/test.py::test_mysql_session 0.00s teardown test_storage_redis/test.py::test_delete =========================== short test summary info ============================ ERROR test_storage_hudi/test.py::test_multiple_hudi_files - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_storage_hudi/test.py::test_single_hudi_file - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_storage_hudi/test.py::test_types - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/.env', '--project-name', 'rootteststoragehudi_gw8', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0_gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns ERROR test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl ERROR test_storage_s3_queue/test.py::test_commit_on_limit - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/.env', '--project-name', 'rootteststorages3queue_gw7', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/old_instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_too_many_parts/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0_gw7/instance_24.5/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered] ERROR test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered] PASSED test_session_log/test.py::test_grpc_session PASSED test_session_log/test.py::test_mysql_session PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options PASSED test_session_log/test.py::test_parallel_sessions PASSED test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with PASSED test_session_log/test.py::test_postgres_session PASSED test_reloading_storage_configuration/test.py::test_add_disk PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] PASSED test_storage_redis/test.py::test_create_table PASSED test_storage_redis/test.py::test_delete PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] PASSED test_storage_redis/test.py::test_select_int PASSED test_storage_redis/test.py::test_simple_insert PASSED test_storage_redis/test.py::test_simple_select PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_policy PASSED test_storage_redis/test.py::test_truncate PASSED test_rocksdb_options/test.py::test_invalid_column_family_options PASSED test_storage_redis/test.py::test_update PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] PASSED test_row_policy/test.py::test_change_of_users_xml_changes_row_policies PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config PASSED test_reloading_storage_configuration/test.py::test_add_policy PASSED test_rocksdb_options/test.py::test_invalid_options PASSED test_row_policy/test.py::test_dcl_introspection PASSED test_reloading_storage_configuration/test.py::test_add_volume_to_policy PASSED test_row_policy/test.py::test_dcl_management PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options PASSED test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml PASSED test_reloading_storage_configuration/test.py::test_new_policy_works PASSED test_row_policy/test.py::test_grant_create_row_policy PASSED test_reloading_storage_configuration/test.py::test_remove_disk PASSED test_row_policy/test.py::test_introspection PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options PASSED test_row_policy/test.py::test_join PASSED test_reloading_storage_configuration/test.py::test_remove_disk_from_policy PASSED test_recovery_replica/test.py::test_choose_source_replica PASSED test_row_policy/test.py::test_miscellaneous_engines PASSED test_reloading_storage_configuration/test.py::test_remove_policy PASSED test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned PASSED test_rocksdb_options/test.py::test_table_invalid_options PASSED test_recovery_replica/test.py::test_recovery PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options PASSED test_rocksdb_options/test.py::test_table_valid_options PASSED test_rocksdb_options/test.py::test_valid_column_family_options PASSED test_rocksdb_options/test.py::test_valid_options PASSED test_row_policy/test.py::test_policy_on_distributed_table_via_role PASSED test_reloading_storage_configuration/test.py::test_remove_volume_from_policy PASSED test_reloading_storage_configuration/test.py::test_update_disk PASSED test_row_policy/test.py::test_reload_users_xml_by_timer PASSED test_row_policy/test.py::test_row_policy_filter_with_subquery PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings PASSED test_recovery_replica/test.py::test_update_metadata PASSED test_row_policy/test.py::test_smoke PASSED test_row_policy/test.py::test_some_users_without_policies PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings PASSED test_row_policy/test.py::test_tags_with_db_and_table_names PASSED test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter PASSED test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter PASSED test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data PASSED test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data PASSED test_row_policy/test.py::test_users_xml_is_readonly PASSED test_row_policy/test.py::test_with_prewhere PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop PASSED test_reload_zookeeper/test.py::test_reload_zookeeper PASSED test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster PASSED test_read_temporary_tables_on_failure/test.py::test_different_versions PASSED test_reload_query_masking_rules/test.py::test_reload_query_masking_rules PASSED test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side PASSED test_replace_partition/test.py::test_normal_work PASSED test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings PASSED test_part_uuid/test.py::test_part_uuid PASSED test_replication_without_zookeeper/test.py::test_startup_without_zookeeper ================== 75 passed, 25 errors in 890.75s (0:14:50) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_cru6dj --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' test_part_uuid/test.py::test_part_uuid test_passing_max_partitions_to_read_remotely/test.py::test_default_database_on_cluster test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_replica/test.py::test_choose_source_replica test_recovery_replica/test.py::test_recovery test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_server_keep_alive/test.py::test_max_keep_alive_requests_on_user_side test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update test_storage_s3_queue/test.py::test_commit_on_limit 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[AzureQueue-unordered]' -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.